18.05 Lecture 5 
February 14, 2005 



§2.2 Independence of events. 

nA\B) = 

Definition - A and B are independent if ¥{A\B) = ¥{A) 



^^^'^^ = = ^^^^ ^ ^^^^^ = P(^)P(i?) 



Experiments can be physically independent (roll 1 die, then roll another die), 

or seem physically related and still be independent. 

Example: A = {odd}, B = {1, 2, 3, 4}. Related events, but independent. 

¥{A) = i.P(S) = f.AB = {1,3} 

¥{AB) = i X I = ¥{AB) = i, therefore independent. 
Independence does not imply that the sets do not intersect. 




Disjoint Independent. 



If A, B are independent, find P(AS^) 
¥{AB) = ¥{A)¥{B) 
AB" = A\ AB, as shown: 




so, FiAB") = F{A) - ¥{AB) 
= ¥{A) - ¥{A)¥{B) 
= P(A)(1-P(S)) 
= ¥{A.)¥{B'') 

therefore, A and B" are independent as well. 

similarly, A° and B^ are independent. See Pset 3 for proof. 

Independence allows you to find P(intersection) through simple multiplication. 
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Example: Toss an unfair coin twice, these are independent events. 
]P{H) = p, < p < 1, find P("TiJ") = tails first, heads second 
P("Tf/"") = ¥(T)¥{H) = (1 - p)p 

Since this is an unfair coin, the probability is not just j 

Tf fair XM. — 1 

j-i icul, HH+HT+TH+TT ~ 4 

If you have several events: Ai, A2, ...An that you need to prove independent: 
It is necessary to show that any subset is independent. 
Total subsets: Aii,Ai2, ...,Aik,2 < k <n 
Prove: P(AaAi2...^,fe) = P(A,i)P(A,2)...P(^»fc) 

You could prove that any 2 events are independent, which is called "pairwise" independence, 
but this is not sufficient to prove that all events are independent. 

Example of pairwise independence: 
Consider a tetrahedral die, equally weighted. 
Three of the faces are each colored red, blue, and green, 
but the last face is multicolored, containing red, blue and green. 

P(rcd) = 2/4 = 1/2 = P(bluc) = P(grccn) 
P(red and blue) = 1/4=1/2x1/2 = P(rod)P(blue) 
Therefore, the pair {red, blue} is independent. 
The same can be proven for {red, green} and {blue, green}, 
but, what about all three together? 

P(red, blue, and green) = 1/4 ^ P(red)P(blue)P(green) = 1/8, not fully independent. 

Example: ¥{H) = p, P(T) = 1 — p for unfair coin 
Toss the coin 5 times ^ P("HTHTT") 

= p(iJ)p(r)p(iJ)P(T)P(T) 
= p(l - - -p)= - p)^ 

Example: Find P(get 2H and 3T, in any order) 
= sum of probabilities for ordering 
= V{HHTTT) + P{HTHTT) = ... 
= p^l-pf+p\l-pf + ... 
= QpHl-pr 

General Example: Throw a coin n times, P(k heads out of n throws) 

Example: Toss a coin until the result is "heads;" there are n tosses before H results. 
P(number of tosses = n) =? 

needs to result as "TTT....TH," number of T's = (n - 1) 

P(tosses = n) = P(rT...i?) = (1 -p)"-^ 

Example: In a criminal case, witnesses give a specific description of the couple seen fleeing the scene. 
P(random couple meets description) = 8.3 x 10~^ = p 

We know at the beginning that 1 couple exists. Perhaps a better question to be asked is: 
Given a couple exists, what is the probability that another couple fits the same description? 
P(2 couples exists) 

A = P(at least 1 couple), B = P(at least 2 couples), find W{B\A) 
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Out of n couples, F{A) = P(at least 1 couple) = 1 - P(no couples) = 1 - n"=i(l -P) 
*Each* couple doesn't satisfy the description, if no couples exist. 
Use independence property, and multiply. 

P(A) = 1 - (1 -p)" 

P(B) = P(at least two) = 1 - P(0 couples) - P(exactly 1 couple) 

= 1 — (1 — p)" — n X p{l — p)^~^, keep in mind that P(exactly 1) falls into P(k out of n) 



If n = 8 million people, P(i3|j4) = 0.2966, which is within reasonable doubt! 

P(2 couples) < P(l couple), but given that 1 couple exists, the probability that 2 exist is not insignificant. 



In the large sample space, the probability that B occurs when we know that A occured is significant! 
§2.3 Bayes's Theorem 

It is sometimes useful to separate a sample space S into a set of disjoint partitions: 



l-(l-p)"-np(l-j3) 
1 - (1 - p)" 



,n-l 



F{B\A) = 





B\,...,Bk - a partition of sample space S. 



Bi n Bj = 0, for i^j,S = ULi Bi (disjoint) 

Total probability: ¥{A) = ^ti H^^i) = ^-=1 nA\Bi)F{Bi) 

(all ABi are disjoint, U*=i ABi = A) 



End of Lecture 5 
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